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Pfrojecf BUILD (Bilingual Understanding Incorporates 
Learniiijg Di'sabilities) was established in September. I976 
in New York Commimity School .District (Manhattan's East 
Harlem), tmder the provision of the ESE'. Title VII. This 
•evaluation s;tudy represents its fourth year of- operation. 
Project- BUILD is a unique » bilingual education program. This 
is so because the Project combines the methodology and con- 
cerns of both special education and bilingual education. 
Its -principal aim is to provide appropriate/ supplemental 
education treatment and opportunities for "bilingual child- 
ren° with leariiing- disabilities. Major activities of the 
|>rogram . include t _ * 

- Identification and selection of bilingual children 
*rtxo have or may have learning disabilities 

- Providing diagnostic -evaluations of psycho-education 
al functioning of children^ 

- Individualized and small group educational and thera 

s ■ ■ 

peutic treatment outside of the regular classroom* 

- Cxirriculum- and material resource development to' sup- 
port the above activities. 

Promoting the iinderstanding of learning disabilities 

among the bilingual parents of children in the Pro- 
**■ ■ < 

ject and -involving such parents in appropriate and 

supportive educational processes. 



The Project build staff consists of a Project Director, 
responsible for overall implementation and management j a 
family assistant who serves as a (li s i sonn et we en the project 
and the parents, and community, who follows up on the individ 
ual children who are treated by external agencies (medical 
.examinations and treatment at local hospitals, clinics, etc, ) 
three' Bilingual Leaniing Disabilities Specialists;, a Psycho- 
logist, used as a consultant for the purpose of psychologic- 
al test and evaluation of the children selected f or^ the pro- 
gram' s direct servlcesj and three Educational Assistants. 

Project "build provides educational and^^t^^epeutic^erv- 
• ices. to 100 children of the Elementary School Level in grades 
one through six. Dulling the year 1979-80 the major concerns 
of the project specialists have been the development of the 
pupil's communication skills in their dominant language y 
minimizing the negative effects of the students specific 
learning disabilities -oh the development of said skills, and 
on their personal and social development. The children attend 
"Bilingual Centers'* at two public schools which provide pro- 
grams , for bilingual instruction, P.s. 72.and P.S. 155. Each 
center is staffed by a Bilingual Learning Disability Special- 
ist and one or two Educational Associates. One of the centers' 
,is .in a non-public school, St» Faul*s. The resource room at 
St« Paul's is staffed by a Bilingual Learning Disability Spec-, 
ialist. No Educational Associate is provided. 



Bilingual c^iildren who are diagnosed as learning dis- 
abled are instructed daily for ^5 minutes. Instruction is 
individual and when necessary' in' small groups. The practice 
of setting aside Fridays for staff meet?.ngs, ^record keepir^, 
"material development, etc. was discontinued for the year of 
1978-79* The ,Project teachers and staff considered that giv- 
en the experience gained by them at this stage of Project 
build's develo.pment, the time can be better used for student 
instruction. . , 

. The assessment, instructional diagnosis and edcuational , - 
evalua'iion of the program's students, as well as individual 
programs for instrvfction are prepared by the Bilingual Learn- 
ing Disability Specialists. The program is concerned with the 
comnmnicatiori skills of the students mainly in their dominant 
laxiguag; their specific learning problems and their personal 
anci social development. The diagnosis ^and individual programs 
of insturctions are discussed with- the Tegular classroom b.l- 
lingual teachers so as to get their input on the recommendat* 
ions and to insure 'follow-up of treatment in their classes* 



SECTION III EVALUATION DESIGN 

• * 

•« The evaluattorvf design for Project BUILD was described 
in the original Project Application of 1976 (p^^ 66-78 )» ^ 

modified" in 1976-77 and 1977-78, and the 1979-80 design' 

^' ■ 
ttodel will .fallow that of- 1979-80. ' . 

■PUPIL ACHIEVEMENT 



The major concern of the project this year was centered 
around the pupil's communication skills, with emphasis on the 
development of reading in the student's dominaint language. 
The objectives related to reading skills in English as well \ 
as in' Spanish will he the" focus of this evaluation- These 
objectives require that each dominant language grade group 
demonstrate -improvement in reading rate as a result -of being 
educationally- serviced by the Project. The progress in other 
educational areas or social skills were not to be forma'lly 
measured* r * 

The Inter-America Series (IAS) Test of Reading and Prueba 
de Lecturat Levels I and II were to be used to evaluate the 
pupil's dominant language reading achievement in English or 

0 N 

Spanish. All the Pre-Test forms were to be given in the fall 
and the Post-Test froms were to be given at the end of the 
school year. The IAS raw scores were converted .to an experi- - 
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mental set of .grade equivalent (GE) scores which were deve- 
).6ped by the Project's previous evaluator. A total of twelve 

* s ■ • 

(12) evaluation obiJectiv^ (two (2) languages times six (6) 
grades) will be evaluated if pairs of usable -scores are avail- 

The evaluation objectives for dominant language reading, 

as in the. previous year, can be stated as follows-:' . 

The instruction and services provided by the Project will 
resulT in the pupil^s gain in dominant language reading, 
sldLlls (as measured .by the Inter- American^Series Test of 
Reading and Prueba de Lecturat as demonstrated by a stat* 
. istically, P » •OS) mean gain in growth ^ total grade 
equivalent scores on each battery t as indicated by a 
comparison of their pretest to posttest ^ean gains during 
the'yeart with their average gains of previous years 
which are to be computed. from their^pretest scores* 

~ ; That is» it was reqxiired that each grade group demonstra* 

ted an improvement in reading growth rate after beginning in 

the' program • ,To determine if gains in reading made by the"^ 

pupils at each grade level were attributable to the program t 

the Bond and Tinker procedure" will be used. This proceedure 

treats each pupil as its own control • For the First Grade 

Pupil without previous school experience t (not -a repeater) t • f 

the- •normal** rate of grotrth inherent in tSe grade eq-uivalent 

scores for these reading test (O.l grade equivalent per month)' 

will be assumed t starting from their actual pretest scores, 

in order to deriv^e -an "expected* or "predictetil^osttest 

score* 'This expected score was* then to be compared with the 

^pil^s. actual., posttest score* 



• EVALUATION OP SDUCATTnWf^T. PRQCESSgS . 

, m • ' 

** > • 

SEIteCTION 

The evaluation data on the effectiveness of^oject sel- 

I .... * 

ection procee^iures was to be- obtained by means of staff inter 
news, examination of Project docuraents and. the study and re- 
view of . pupils screening and achievement records. ^ 

DIRECT SERVICES ' 

For the assessment of direct services provided by the 
Project's staff to the participating pupils 'the ■ Consult an.t • 
was 'to visit the centers for informal.- observations^ conduct' 
staff interviews, and submit questionnaires to the schopl 
sjtaff . ■ ' • : 

INDIRECT SERVICES 

For assessment of indirect services provided by the 
Project staff to other students in the Centers the Consul t- 
ant was to visit the Centers, interview the Project staff", 
and submit questronnai'res to the school .staff. 

STA>P DEVELOPMENT - \ ' 

The attainment of ^ob-jectives related, to staff develop- - 
ment was to be assessed through interviews with Project ' 
teachers "and the Project Director. 



CtTRRICULUM MATORTALR 

' The attainment of objectives related, to curricultim 
aaterials was to be assessed by observation at the Centers 

* . * * 

and interviews with the staff* . " 

PARENT INVOLVEMENT . " 

• The attainment of objectives related to parent involve- 
ment was to" be assessed by questionnaires and through inter- 
views of parents and staff. 



■ SECTION III - EVALUATION PINDINGS . ^ 

In this section evaluation findings are presented, with 
a minimum of inter;pretative commentaries* The interpretat- 
ions of* the evaluation findings will be discussed in the f ol- 

,1? . 

lowing section* 
PtJPIL ACHISVEMENT 

RBADINGt ENGLISH AS A DOMINANT- >LANGUAGE ' 

The results of the Bond and Tinker analysis of English 
as a dominant language reading are given in Table 1, (Page^ 9 J 
A total of twenty*nine (29) valid pairs of prexest and post- 
^test scores on the IAS Test of Reading were obtained for all 
grades in the Project. For the third and fourth grades only, 
five (5) pairs, of grades were available; nine (9) and seven* 
(7) pairs of scores for the second -and fifth grades respect- 
ively, three (3) for the first grade. ' , 

The first graders obtained a higher iactual posttest mean 
score than the expected posttest mean,socre, but the differ- 

ence was not statistically significant. These findings must 

--^l— — ^ 

disregarded as questionable because the students had no 

^previous schooling and the "normal** rate growth i^^^^^'t in 

the grade equivalent scores of these tests assumed, i»e. 

©•1 GE per month, staining from their actual pretest score 

in order to. derive the expected or predicted posttest score* 

A- more definate analysis of th^ first, grade English reading 

achievement scores is given in Table 2 (page iO ) # 
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TABLE - I 



« English as 9 Dominant Language 1 Reading Achievement 

Inter-American Series, Test of Reading 
. <fGrade Equivalent Total Score Analysis 

Bond and Singer Method : 



Actual Post-test Scores 



Expected Post-test Scores 



Grade 

i 


Level 


Numbl^ 
Tested 


Mean 
(GE) 


Standard 
Deviation 


Number 
Tested 


Mean 
(GE)^ 


Standard 

Deviation 

9 


•t (d) 


First 


I 


3 


1.9 


-.47 


3 


1*7 


r 

.2 ■■ 


1.836 


Second 


II . 


9 


.3.0 


05 


9 


2.1 ' 


.68 . 


2.184 • 


Third 


11 


5 


30 


.94 


.5 ^ 


2.7 


.75 


2.786 


Fourth 


II . 


5 ./ 




.68 


5 


3.1 


1.3 


2.014 


Fifth 


II 


7 


4.1 


.82 ■ 


? 


3.8 


.94 


2.00 



o 
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TABLE 2 



English as a Dominant Language t Reading Achievement 
Inter-American Series," Test of Reading 
Grade Equivalent Total Score Analysis • 
Pre-test - Post-test Method 



. Pre-test Scores 



Post-test Scores 



Grades. Level Number Mean Standard 

Tested (GE). Deviation 

First I . V U . .22 ^ 



Number Mean 
Tested (GE) 



1.9 



Standard t (d) 
Deviation 

.4? IM2? 



Second II . 9 1.8 , ..55 



Third 



'II 



5 ■ 20 



3.0 



.55 ' 3.^042 



3.3 ' .9^ 5.1538 



Fourth II 5 .2.? 



Fifth 



II 



1.1 



7 3.^ ' .81 



.68 . 3.?21? 



.82 2.618? 



The second graders achieved their ob jective^for English 
reading obtaining an actual posttest mean of 3. 01 (SD = .55) 
with t =2.184 as compared to an expected posttest mean pf 
. 2*1 (SD = .W) 

■ ■ . ' . . •* 

The third graders obtained an actual posttest mean of 

3»3 (SD = .94) as compared to an expected posttest mean of 

72.7 "(SD.= .75) with t = 2.786. The third graders- achieved 

0 their English reading objective. „ 

Si n 

The fourth graders obtained and actual posttest mean of 

^ ■ , ^ ■ - ■• . 

4.0 (SD = .68) "as compared -to an expected p'bsttest meaij of ' 

'3*1 (SD.= 1«3)» This group narrowly missed achieving the 

desired statistical criteria. The fact that the group is 

small and that the criteria was missed by a narrow margin 

tends -to suggest that the ach^-evement- of the fourth graders 

jjiay be 'educationally significant. ■ 

The f)ifth graders failed to achieve their objective for 

English reading by a small margin. They scored an actual 

^ ' ■ .. ■ ■ ■ 

posttest mean of 4.1 (SD = .82) as compared, to an expected 

posttest eman of 3.8 (SD.= .94). ~ 

Table 2 gives a re-analysis of the scores for English 

as" a dominant language reading utilizing a (t) ,test comp- 



arison of pretest and posttest scores. As is shown in -Table 
2« the. third graders demonstrated a highly significant imp- 
rovement ih mean scores. Grades two,, three and five demon- 
strated a statistically significant improvement in their mean 
scores.; The first grade did not Improve their mean scores to 
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show a significant difference. It is to .^e noted that with 
so -few socres no complete and defrnate statement can 'be made 
as to the educational significance of the first grades achieve- 
ment; " . - 

READING I SPANISH AS A 'DOMINANT LANGUAGE 

! gh€— results of the Bond and Tinker analysis of' Spanish, 
as a dominant language reading are given in. Table 3 (page 13 )« 
A total of twenty-six valid pairs of pretest and posttest 
scores on the IAS Prtteba de Lectura were obtained for grades 
one (1) through three (3) and grade five (5). 

The first graders obtained a substantially higher actual 
posttest score than the expected posttest mean scores They 
achieved their reading objective for Spanish reading. However,^ 
these results; can be disregarded as questionable for same 
reasons as given for the first graders tested in English; •. 
the Bond and Tinker method is not' totally appropriate for the - 
students with no previous academic experience # 

The third .graders- significantly achieved' their objective - 
for "Spanish reading I scoring an actual posttest mean of 3«5 
(SD = •83). as compared to an expected posttest mean of 2.? 
-fSS-— .-83^b— — — ^— 1 . 

■ ■ ■ o 

; The second and fifth graders achieved higher actual post* 
test scares than expected posttest scores. The second graders 
achieved criteria, the fifth graders came 'close to achieving 
the "criteria in this analysis* , - 



TABLE -3 

• Spanish as a Dominant Language i Reading Achievement 
Inter-Americana Series, Prueba de-Lectura 
Grade Equivalent Total Score Analysis 
Bond and Sin^ir Method 





J 


Actual Post-test Scores 


0 

Expected Post-test Scores 




-Grade 

V* • 


Level 


Tested 


if 

Ma An 
(GE). 


Deviation 


liUluUDr 

Tested 


Mean 
(GE) 


V ' 

iDxanaara 
Deviation 


t(d) 


First 


I 


\ 8 


3.2 


• M 


. 8 


1.7 


•52 ■ 


7.129 


"Sefcond 


11 




3.2 


.67 ■ 


9,. 


2.7 


1.1, 


•2.139 


Tliird 




^X 


3.5 


' .83 


7 ■ 


2.7 


■ ■ ..63 


2.640 ' 


/ Fifth 


11 


3 




\ 1.2 


3 


3.5 

1 


.75 


2.000 



(13) 
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TABLE- 4 

Spanish as a Dominant Language t Reading Achievement 
Inter-Americana Series, Prueha de.Lectura 
. Grade Equivalent Total Score Analysis 
Pre-test - Post-test Method 







^Pre-Test^ Scores 


Post-Test Scores 




Grade 

• V 


Level 


Number 
Tested 


Mean Standard 
(GE): Deviation 


Number 
Tested ' 


Mean 
' (GE) 


g vCUlUCU U 

Deviation 


• t (d) 


H 

First 


I 


9 

•8 


'u 


8 


3.2 


M 


8.465 


. Second 


II 


B 


2.3 


8 


3-2 


.67 


2.8022 


Third 


II 


7 


2.4 


? 


3.5 


.63 • 


3.735 


Fifth 


. II 


3 


>^ 


3 


4.4 




2.519 



1.: 



09 
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The pretest - posttest analysis of Spanish reading 
achievement given in Tatle 4 (pag eli» ) shows that the first 
and third graders made a highly significant improvement in 
their mean reading scores. The Tsecond graders- also showed 
Improvement in their me^ji reading scores. The fifth gradar.s 
achieved a .9 increase that was not statistically significant, 

' The grades malcing significant improvements in Spanish 
reading also demonstrated this in their mean scores; the 
first graders advanced by a 1.8 grade equivalent from 1.^ to 
3«2j the second grade adavanced by a .9 grade equivalent from 
2. 3 to 3*2 and the third grade advanced 1.1 grade equivalent ' 
from 2«^ to 3«5. ^ 

SELF CONCEPT 

A very modest effort was made to assess self-concept* and 
the test, Rosenberg's Self -Concept Inventory , was administered 
at the beginning and conslusion oif the academis year. J^able 
5 (pag e ) Ogives the results. A total of twenty-seven (2?) 
usable pairs ■> of scores were- selected from the English domin- 
ant groups and twenty-eight" (28) usable p4irs of score's were 
selected from the Spanish dominant groups. The mean socres 
differ very little 'from pretest to posttest in both groups. 
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«^ TABlE » 5 

Self -Concept 1 English and Spanish Dominant Students 
.Tes"i.j Rosenberg Self -Concept InventoVy 
' Pre-Test - Post-Test Method 



English Dominant Grou-p 
Pre-Test Scores Post-Test Scores 

N . ^ 29 - 29 . 

M 6.62 6,72 

SD 1.8 . - 1.8 



' Spanish Dominant Group - 
Pre-Test Scores Post-Test Scores 

N. " 28 - 28 

M 7.2. 7.6 " . 

SD „ 1.6 / 2.3 




PUPIL SELEClrlON 



PROGRAM EDUCATIONa£ PROCESS . 

'Project BUILD services bilingual children 'who are con- 

sidered learning disabled. The criteria for selecting the 

students to the Project, reads, "a significant descrepancy 

between academic skills' and general ability". Since jaost of 

the children enrolled last year are still "participating in 

the Project, the battery /of selection instrumients was admin- 

i^ered ^mostly to incoming firs year students. • -^^ 

- . ' ' '• 

The potential participants were given the New York City - * 

• ^ ^ « 

Language Assessment Batteary fLAB) as the only measure of .lartg- 
. uage dominance. Then, eitiier the Wide Range Achievement Test 
or the Prueba de Habi li dad General > (depending on the language 
dominance) and Goodenou^-Harris Draw-a-Man ' were given to 
identify -pupils with discrepancies between academic achieve- 
ment and. general ability. The Slingerland Screenir.:. T-:gts for 
] Identifying Children with SDecific Learning Disabili'c . -^s were 
' given to determine language impairments that- relate to reading t 
wiiting, si>elling and speaking. ^ 

/ One htmdred pupils were enrolled „in grades r tifirough. 6 

to-recieve the Project's direct services* By the end of the. ' 
academic -year 1979-80 the Project was serving approximately 

' 84 students, as 16 had been transferred out of the participat- . 
ing schools. Pupils detected by the screening battery' as hav- 
ing minor learmng problems recieved indirect services from r 
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the Prdject staff in the form of informal consultation with 
the bilingual classroom teachers and suggestions and sharing 
of materialSi 



In this Consultant's opinion there is evidence to .indi- 
\cate tljat Project selection proceedures were generally valid 
dtiring 1979-80. The analysis of the achievement of students 
selected this yeat supports the Project's selection of pupils* 
Of the group selected for the English-- dominant group all were 
performing xinder grade level. In the Spanish-dominant group 
only 9 approached to near grade level functioning in reading 
but their functioning in Math is very low. The posttesting 
in^cated that despite individual gains'ih-th^ English -domin- 
anf girdup therfe are .fifteen (15) students who are not achiev- 

ing>.their 'expe^ed . level in reading. In the Spanish- dominant - 

* - . i> * » - 

group there arei five (5) students that have 'raised their read- 
ing rate but. who.Jare still woriing below\heir expe.cted g3^de 
iereis. Low achievement in an by itself does not indicate 
learning disabilities and the Project Staff and^thls Consult- 
ant agree that^some of the selected pupils are not trixe learn- 
ing disabled t but that their school performance is -affected by- 
either social or emotional :factors« However, considering the 
present state of- the. art in the field of learning^ disabilities 
regarding definition and need of valid and reliable techniques 
for its diagnosis f some problems in the selection of partici- 
pants are to be expected. 
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Moreovert because of this Project/ s imiquenessi its Staff is 

also confronted with the total lack of reliable and valid. . 

criteria to detect this condition with absolute precision in 

bilingual children* ^ ^ 

^ ■ ^ 
The use of the Goodenougjfi-Harrist Draw- a* Man as a measure 

of general learning ability is considered inadequate for the 

*• ^ 
purposes of this ^Prb ject » given that the only aspect of. int- 

.•t ^ ' 

c 

elligence the instrument measiires, is detailed recognition. 

DIRECT SERVICES 

I The Project's Centers were visited by this Consultant 
during vsgrious periods -throughout the second semester of the 
acadeojis year of 1979-80. The direct services provided by the 
Learning Disabilities Specialists and other Staff members were 
in this Consultaht • s opinion effective and in compliance with 
the Project's specifications. Educational evaluations were 
•written for each admitted student and the findings^ were, in- 
corporated into the individual educational plans used by the 
Specialist to guide the student "s daily individual instihict- 
ion'. With the English- dominant group the Woodcock Reading 
iwlstery Tests and the Key-Math were used in diagnosing weak- 
nesses and strengths in reading and math respectively. As 
is the case with the screening instruments, there is an almost 
total lack of valid diagnostic instruments that can be used 
with bilingual learning disabled (especially in Spanish) child 
ren* It was encouraging to observe how the teachers and the 
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staff being confronted with this problem have developed in- 
fomal diagnostic tasks and are using the diagnostic inform- 
ation thus obtained to plan: the student's instruction. In 
"addition to the individual educational plans a profile sheet 
and progress record in reading and math were maintained for 
each student . 

• All students, screened and accepted, to loe serviced by 
Project BUILD are given a< psychological evaluation. 

As^ reported by the Pro jecf Learning Disabilities Spec- 
ialists dxiring the year 1979-80 five of the newly admitted 
students were ^referred to outside- agencies. 

After several, in- site observations of "the Project BUILD 
Staff, this Consultant 's" opinion is that the strongest comp- 
onent and ^most encouraging aspect of the Project. is the teach- 
ing component? how the Learning Disabilities Specialists and 
the Educational Assistants implement their teaching. It is 
rewarding to observe their efficiency, and how they carry out 
instructional and remediational activities in their respect- 
ive, laboratories. They are able to create a supportive environ 
ment that paired to effective use of well structiired teaching 
practices promotes the student's learning and their motivation 
for learning. They seemed tireless in their efforts to help 
the s"Jnidents and work with them. 

The questionnaire survey of eleven (11) regular bilingual 
classroom teachers indicates that they considered the direct 
services of the Projedt vital to their schools and the other 
five (5) considered the services an advantage to their schools. 



INI3IRECT SERVIGES 

In interviews between this Consultant, the Project 
'Director and the Learning Disabilities Specialists it was 
..indicated that whenever possible t'hey assist the bilingual 
classroom teachers by suggesting appropriate teaching tech- 
niques and materials to be used with the Project's students 
as well as'with the other bilingual students in the class.' 
They also indicated that given the number of students seen ^ 
during the day the time factor limits somewhat these indirect 
services on their part. Nevertheless.' che eleven (11) class- 
room teachers who- answered the questionnaires reported that 
commimi cation in general, between the Learning Disabilities 

Specialists has increased notably. (See Appendix ). 

This Consultant feels that a good learning resource cen- 
ter in each of the schools is an effective and useful way of 
■> 

rendering indirect. services! to the other classes in the school. 

I • • 

' * ^ I 

1 

STAPP DEVELOPMENT > 

The Staff development this year is considered by this 

iff 

Consultant as satisfactory. The Project Staff participated 
in: a series of in-service workshops conducted by the Project 

Director and an outside consultant. Three of the teachers are 

■ I - ■ 

enrolled in Learning Disabilifties Masters programs at a local 

university. The Staff still Considered, as was communicated 

i 

to this Consultant, that, "the need for training in the practi- 
cal and every-day ways" of teaching bilingual learnind disabled 
is greatly needed. 



PARENT INVOLVEMENT 

As indicated by the Project's Staff in a personal. inter- 
view with this Consultant, parent involvement in Project 
BUILD has improved somewhat. In the thirteen (I3) question- 
naires received from parents, five (5) were said to have att- 
ended fiv3 .(5) meetings held by the Project this year. - All- 
respondents have talked to the Project Staff members more 
than once during the year.' All but one respondent are said 
to have participated in the different activities sponsored 
by the Project* Twelve (12) respondents have actually ob- 
served classes from one <1) to three (3) times. All respond- 
ents acknowledged the fact that communications from the Pro- 
ject have been recieyed by them in the form of: bulletins, 
letters, announcements, notes, and telephone communication. 
One' (1) respondent informed of a visit from the family coor- 
i^ihator. 

CURRICULAR MATERIALS ' ■ .■ I 

A considerable amount of materials were ptirchased by 
the Project* Both the Staff and the Bilingual Classroom 
Teachers have accessibility to the curricular materials. 
Although it is known .of the limited number of dialectic 
materials in Spanish, the Project Director has been attent- 
ive to' the new releases of adequate materials published in 

f 

Spanish and has acquired some. Driring on-site visits to 
the Centers this Consultant has observed a sizeable amount 
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of ciirricular materials either adaf)ted or produced the 
Project Specialists, yet no systematic effort has been made 
to collect them and prepare them in such way so as to malce 
theif use possible by other teachers and with other students. 
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SUIWARY 

BIUNGO AL CLASSROOM TSACHBRS* QUESTIONNAIRE FINDINGS 

Eleven (11) bilingual classroom teachers responded to 
the questionnaire submitted to them by this Consultant. The 
majority (72^) of the respondents considered the selection 
of pupils made' by Project BUILD for the acatfemic year 1979- 
80 above average or outstanding. 

The improvement in reading, reading motivation, math, 
social behavior, .and self esteem was perceived by the res- 
pondents as mainly due to Project effectiveness as was the 
progress of the pupils exacted from the program. Six (6) 
of the eleven (11) ' teachers considered the Project services 
as vital to their school. The remaining four i^-) teachers, 
considered Project services as an advantage to their schools. 

In assessing the Project's direct services two (2) of 
the teachers wrote the following comments! 

"I felt that the services were very-good. The children 
look forward to going to classes. They have re^cieved 
- the instruction on a "one-to-one" basis that I could not 
provide". 

And I "This program gives the children the opportunity to re- 
ceive individual help, working in small group situations 
whi-dh» I think, is very valuable for these children". 
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SECTION IV - DISCUSSION AND INTERPRET ATI Ol/ OF FINDINGS . ' 

In this section the Consultant will discuss and will try- 
to interpret, to the best of her judgement, all the findings - 
presented in the previous sections* 

< ■ '■ ■ ' 

PUPIL ACHIEVEMENT 
READING 

Two types "of factors. will first be considered, that in 
this Consultant's opinion have affected the findings of this 
evaluation, and furthermore, hav* complicated their inter- 
, pretation.. There are general factors that affect the imple- 
mentation of Project BUILD or any other similar program which 
intends to service students who are bilingual and learning - 
disabled* For onet the lack of available information as to 
what, are the important components of educatioiial programs for 
bilingual, learning disabled students and how they are to be 
evaluated • The guidelines for the implementation and jevalua- 
tion of such programs, to the best of this Consultant's know- 
ledge,^ have been originally devised either for bilingual pro- 
grams or for learning disabilities programs,- but not specif i- 
c ally for educational programs serving students who are j both • 
The rwo educational areas are still beset by questions in ref- 
erence to proper definitions of students to be served; .reason- 
able goals and objectives relating to the rate of learning; 
the lack of oppropriate screening and' diagnostic instruments, 
appropriateness of standardized testing instruments to meas- 
ure progress in learning, the areas of academic and socila 
learning to be stressed by program treatment? length of time 
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and>f^;f~ : ancy of instruction in both the regular class and 
the V -.^nt facilities. All of the above are part of the 
mentioned lack of information and guidelines for program im- ' 
plementation and evaluation that complicate the interpret- 
ation Of findings of Project BUILD. 

The second type of factor that affects and limits the' 
interpretability of Project BUILD 's evaluation findings are 
more specific as related to the project. Due to the nature 
of this project, as has been true in previous years, the small 
number of scores available at each grade level limits the mean 
ingfulness and generalizability of reading results. 

The Bond and, Tinker method of analyzing reading scores 
uses each student as his/her own control, thus, its use mini- 
miz'fes the problems of loss of students due .to mobility and 
the difficulties involving other groups for testing. Yet, the 
method is not totally appropriate for first graders without 
previous school experience. The rea_ding performance of these 
groups was mainly judged by the pretest - posttest comparison 
of their mean scores. The method i<ie*tlly should be used to 
analyze re.ading growth for a program's whole history, not just 
for the span of one year. Again, because the nature of the 
project and the locations of the settings, to apply the methd 
for three or four years of the Project's service, would have 
resulted in less available us^le pairs of scores to analyze . 

For an educational program whose main cbjectives are re- 
lated to communication skills for bilingual, learning disabled 
students- the correct determination of language dominance of 



the serviced students is an important one. I^a^^t year it was 
possible to o.btairi hard data on the lack of adequacy of the 
classification of the Project's students as to their languag 
dominance. Such data is not available this year, but, the 
Project staff has indicated to this Consultant that through 
their work vrith the students they have become aware of the 
need for more accurate methods to determine language domin- 
ance* The learning problems exhibited by the Program's stu- 
dents may demand a more in-depth assessment of their lang- 
uage' dominance* (Recommendations to this effect will be 
made in the proper section.) 

Besides the small number of student scores to be used 
in the Project's evaluation; the xiniqueness of the Project 
that makes guidelines arid information scarce; and the doubt 
as to how exact the established participants language i domi- 
nance ist there is still another factor to consider when in- 
terpi'eting the Project's evaluation results. The present 
evaluation design is not totally effective in separating the 
impact of Project BUILD in reading achievement as opposed to 
the' impact of the regular classroom. The general academic 
progress of students served in a resoxirce room setting is 
the product of the combination of services in both settings, 
the exact calibration of the impact of one over the other 
demands a special design which can be worked into the comp- 
lications of such an educational arrangement and the daily 
realities, of school- fxsnctioning* 
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With the above conditions" in mind, the overall assess- 
ment of students' reading achievement "during the academic 
^ year 1979-80 is summarized in Table 6 ( page 29 ) and Table 
7 (pag e "^0 ) and shall be discussed. ^ 

Table 6 summarizes the readin,^ achievement of groups 
of students whose dominant language is English. The third, 
fourth and fifth grades met their objective fully, and the 
second grade approached criteria in one method and met cri- 
teria in the other. The second grade achieved its reading 
English objective in a weaker way than the rest of the 
grades* The first grade students improved individually on 
their reading scores* but the improvement as a group was not 
meaningful and their achievement was undetermined. 

Table 7 sxuamarizes the reading achievement of groups of 
sutdents whose dominant language is Spanish. The first, 
secong and third grade achieved their reading objectives, 
with the first and second grades achieving their reading ob- 
jectives strongly. .The three students in the fifth grade 
closely achieved criteria in one method and gained 2.2; 
and 1.3 grade level in the other. Their gains as a group in 
the Bond and Tinker method was close to criteria, the few 
scores made it difficult to determine the meaningfulness of 
the restilts. statistically speaking. But in this Consultant's 
opinion, the fact that two students improved their scores to 
equate a one grade equivalent is educationally meaningful. . 
The student in the fotirth grade improved his reading grade 
level by .3. i 

o 
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. TABLE 6 

• EWGLISH AS( A DOMfN^N'P UNGUAGE READING OBJECTIVES 
?xtftnt To Which Grade Achieved or Approached nriteria of ?,.0> 



Grade 



Number of 
Students 



Bond and Tinker 
Method 



Pre-Test - Post-Test 



1 


3 


X 




2 


9 


Achieved 


Achieved 


3 


5 


Achieved 


Strongly Achieved 


k 




Achieved 


Strongly Achieved 


5 


? 


Achieved 


Achieved 


6 


1 




(Improved by .9 G.E.) 



X - Undetermined 
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TABLE 7 . ^ . : 

SPA:NISH AS A DOMINANT LANGUAGE READING OBJECTIVES • ' 

Extent to which Grades Achieved or Approached Criteria ' of- P = .OS 

Grade Number of- Bond and Tinker Pre-Teat - Post-Teat 

Students Method 



1 


a 


Strongly Achieved 


, Strongly Achieved 


2 


8 


Achieved 


Achieved 

* 


3 


( 


Strongly Achieved 


Strongly Achieved 






X 


(Improved by .3 G.E* 


5 




Closely Achieved 


Achieved 



•Por-the English groups the data available made possible 

■ ■ t. ' * • ■ 

the evaluation oi five reading objectives out of the possible 
six*" ( The sixth grade objective could not be subjetted to 
any analysis dxie to a, lack of available scores.) Pour of the 
five objectives -evaluated were attained. The first graders 
nade individual progress In their posttest scores, but as a 
group the increment was ndt statistically significant to reach 
the Project's established standard to consider, their object-- 
ive obtained. 

For the Spanish" groups the diita available made' possirble 
the evaluation of four of the Project's reading objectives. 

The objectives for the fourth and sixth graders were not • ~ 
measured because there was only one student in the foxirth 
grade antf none in the sixth grade. Pour out of six reading • 
objectives for Spanish were measured. All groups attained 
their , Spanish reading objectives. *The fifth graders were short 
of crd|teria on the Bond and Tinker method, but* achieved in, 
the otiher method (.99^ grade level). In consideration of the 
few cases .involved it is this Consultant's opinion that the 
reading objectives for Spanish were attained by the fifth 
graders. 

Project BUILD achieved success this year in promoting ^ 
the ^achievement of its English and Spanish reading objeict- 
ives. Of the four achieved reading objectives for English;- 
two were strongly achieved and two wer achieved in an. ade- 
quate manner. Of the four achieved Spanish objectives, two « 




were strongly achieved, on adequately achieved and one was - 
achieved in a weak manner. ' . 

In sum, diiring the 1979-80 academic year Project BUILD ' 
achieved eight of the nine reading objectives, and further- 
more, this Consultant must- indicate that students served by 
-Project BUILD actually recieved none months of direct Project 
. instruction, not ten. since the first month of the academic 
year -is dedicated to the implementation of the screening and 
selection proce.edtires. 

OTHER AREAS OF ACHIEVEMENT 

During visits to the Project Centers, this Consultant 
found other evidence that indicates Project BUILD' s impact 
on the students it served. The l)ilingual classroom teachers 
perceived that Project 'students are more active in classroom 
participation, improved in both receptive and expressive lang- 
uage, more willing to participate in classroom activities, and 
a good majority exhibiting very accepatble classroom behavior. 
In their replies to the questionnaires presented them they 
^attribute the progress made by the students in reading, math 
and behavior to Project BUILD' s intervention. 

SELF*CONCEPT . " ' 

— ' ■ • . ■ ^ 

The self -concept test i Rosenberg Self -Concept Inventory ; 

was administered at the beginning and at the end of the -aca-' 

"denic year-1979-80« The English .and" Spanish dominant group^ 



both showed a slight increase in their mean scores on the 
inventory. The 'dirference in improvement is insignificant 
so as to permit any reasonable interpretation. The Project's 
Specialist in Learning Disabilities and the Educative Assoc- 
iates expressed to- this Consultant that the students, while 
talcing the test, seemed reluctant and not enthusiastic about 
answering the questions presented. 

Aside of the test results, the 'Specialist , the Education- 
al Associates and the bilingual . classroom teachers plus the 
parents interviewed, agreed that, by the end of the year many 
of the -students serviced by the Project acted more confident, 
appeared happier and more comfortable in school. 

PROGRAM EDUCATIONAL PROCESSES 

The selection of students to be serviced by Project BUILD 
for .the year 1979-80 has been done by the Project Staff plus 
some input by the regular classroom teachers. Although the 
"discrepency criteria" (not totally accepted in the field of 
learning disabilities) still appears in the Project plan, the 
definition given by Federal Law PL 9^1^2 (The Education for 
All Handicapped Children Act) was considered when the screen- 
ing and selection was done. 

The selection proceedures for the academic ye^ 1979-30 
were generally valid, but improv^^^it is indicated by a sel- 
ection of better measures of general ability and achievement 
meastares in Spanish. 



DIRECT SERVICES 

The direct services proVided by the Project are effect- 
ive and in compliance with the Project's specifications. 
Educational evaluations .were' done by the Specialists and a 
number of diagnostic instrtzments in English were used to dL- " 
termine the strengths and .weaknesses in the students learning. 
As a remedy for the lack of informal diagnostic tests in 
Sp^iish, the Bilingual Specialists have developed informal 
diagnostic tasks for both reading and math. The diagnostic 
information is' incorporated into the plan of instruction for 
each student. • . 

Project students recisved daily instruction at the Pro- 
ject's laboratories or resource rooms for a period of fourty- 
five minutes daily. Records are kept of the students' progress 
in the different communication skills. 

The Project Director worked ^^^^jj^ ^i"^^ "^^^ Bilingual 
Learning Disabilities Specialists and was very attentive to 
their needs for implementing instruction. Feedback, on site 
supervision andl meetings, both in groups and individually 
were offered throughout the year 1979-80. The comfortable 
professional relationship that exists between the Project 
Director and the Staff was very evident to this Consultant 
when attending meetings and activities. The strongest com- 
ponent of the Project is the teacher's component; the Bi- 
lingual Specialists and the Educational Associates. They can 



ERIC 



(34) 



promote respect and maintain appropriate classroom "behavior 
of ^the individual student as well as of groups of students; 
• select appropriate methods and materials with- which to teach 
..the students; produce and use well teacher-raade materials and 
adapt commercial materials. Their initiative and enthusiasm 
is evident in the different activities conducted by them in 
the resource rooms* 

INDIRECT SERVICES 

Indirect Services were provided throughput the year to- 
other classes and to students in the bilingual regular class- 
rooms in the form of suggestion of appropriate teaching tech- 
niques and miaterials tp be us'ed# 

Although no specific time was set aside during this past 
year for the Bilingual Specialist and bilingual classroom 
teachers to meet, the bilingual teachers indicated that commu- 
nications between the two groups has increased this year# Of 
eleven (XI) bilingual regular classroom teachers consulted, \^ 
eight (8) indicated that they would like to recieve training ^ 
in the field of learning disabilities. In this Consultant's 
opinion the Project Staff is well qualified to offer some of 
this training.. The training of the bilingual regular teach-" 
ing staff will be of benefit to the Project's students as 
well as the students in the regular classes, to whom some of 
the techniques, and proceedures in the field of learning dis- 
abilities can be applied. 



STAFF DEVELOPMENT 

The Staff of Project BUILD has participated with great 
enthusiasm in the series of workshops conducted by the Project 
Director and anoutside Consultant. The Staff is receptive 
to tra^iingand their efficiency in the resourcs rooms reflects 

benefits recieved from formal training at the Universities 
as well as from the workshops offered by the Project. Their 
assistance to professional activities in- the areas of biling- 
ual education and learning disabilities has been very satis- 
factory this year. - 

PARENT INVOLVEMENT 

. Parent involvement in Projecx BUILD improved during the 
past year. More parents visited the resource rooms and 
sought communication with the Project Staff. Due to the 
nature of the learning problems faced by the students, serv- 
iced by the Project a greater parent involvement is needed. 
Written commtani cation in the form of short newsletters or 
bulletins, published.®'* ^ regular basis should be experi- 
mented vidth. . ' 

CTORICULAR MATERIAL 

T'he amount of materials pxarchased by the Project is con- 
sidered to be satisfactory. The initiative and alertness of 
the Project Director is evident in this aspect of the Project. 
There is a considerable amoTint of materials either adapted- or 



(36) 



produced by the Project Soecialists that deserves to be 
prepared so as to have said material available for re-use 
and dissemination* 

SUMMATION * 

Despite ^all, the limiting factors enumerated throughout 
this report affecting Project BUILD* s functions and evaluat- 
ions asyan educational program it can be said that this pro- 
gram was highly successful during the academic year of 1979-80 ♦ 
The Project's reading objectives for its serviced students 
in both languages were attained* Improvement in other areas t 
althotigh not quantitively measured, was evidenced by other 
less exact but acceptable ways, (i«e*, observations, personal 
communication, teacher and parent perception* ) 

The assessment of the student's achievement, in this 
Consultant's opinion was complicated and not completely satis- 
factory* The uniqueness and nature of Project BUILD defies 
the appropriatness of the evaluation design and the analysis 
and interpretation of results. 

The Project's educational processes of selection, direct 
and indirect services, staff development, parent involvement, 
and curricular materials were well implemented. 

There is no doubt that the Proje*ct has improved in all 
of its components and despite all the problems mentioned con- 
tinuation of the Project is recommended* The continuation is 
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justified by the findings of this evaluation precisely due 
to its experimental nature. The Project's continuation with 
the primary aim to develop a model program that will benefit 
and enhance the educational services for both bilingual and 
learning disabilities populations, is indeed recommended. 



SECTION V - RECOMMENDATIONS . " 

1. Incorporate the Federal definition of learning 
disabilities. 

2. Supplezaent the use of the LAB with the Boehm Test 
of Basic Concepts (English and Spanish) as a way 
to insiare effective assessment of language domin- 
ance. . 

3« Experiment with the use of the Raven Progressive 
Matrices this year to determine if it is a more 
sensitive measure of ability for bilingual child- 
ren as opposed to the Goodenough=Harris, Draw-a- 
Man . 

^« Consider using the Horst Test of Reversals for 
added screening information. 

DIRECT SERVICES 

.!• Insist on daily instruction at the laboratory rooms 
for each student. 

2. Review the format of the individual's educational 
plan. 

3. Specify and write an '"exit of program criteria." 

^. Consider the training and use of peer tutors in the 
resource" room. 

INDIRECT SERVICES 

!• Plan with school directors for training of bilingual 
classroom teachers. Most of the training can be • 
carried by the Bili"ngual. Learning Disabilities Spec- 
~ ialists. 
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CURRICDLOM AND MATERIALS 

1* Devise a way to collect and prepare for disseminition 
teacher-made materials. 

2« Stay attentive • and ir^ormed of new curricular 

materials, both Spanish and English, designed for 
bilingual and/or learning disabled children. 

PARENT INVOLVEMENT 

!• Plan and initiate the publication of a short news- 
letter or bulletin specifically directed to the 
Project ' s parents . 
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RESULTS OP ELEVEN (11) QUESTIONNAIRES COLLECTED FROM 
BILINGUAL REGULAR CLASSROOM TEACHERS 

I How woxild you rate effectiveness of Project Btiild inj 

A» Selection of pupils 

Unsatisfactory 
Below Average " 

Average A 27 . 3% 

Above Average • "^5 ^5.^ 

Outstanding - 3 • 27.3% 

B# Improvement of pupil motivation to read* 

Unsatisfactory * — , 

Below Average 

Average 3 ' 27#3^ 

Above Average 5 ^3*^% 

Outstanding 3 27^3% 

Improvement of reading in English Dominant child* 

Unsatisfactory 
Below Average 

Average ' - 5 * 50?^ 

Above Average 3 3^% 

Outstanding "2 20% 

D« Improvement of reading in Spanish Dominant child* 

Unsatisfactory - 

Below Average — — 

Average t ^0% 

Above Average ^ ^0% 

Outstanding 2 - * 20% 

Not applicable 1 

£♦ Improvement in Mathematics 

Unsatisfactory . " ' 

Below Average 1 - 9^ 

Average . , ■ ^ - 36.^ 

Above Average '* 36.^^ 

Outstanding 2 18.2^ 
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p. Improvement . in socialization and behavior. 

Unsatisfactory — 

Below Average i 'gZ 

Average * 4 3|7^5g 

Above Average 3 07 

Outstanding 3 If.'j^ 

G. .Self -Esteem 

• Unsatisfactory _ — 

Below Average ' , 

Average ■ " 3 27' 3% 

Above Average . 4 ^(^'iS 

Outstanding ; 4 36.'22 

H. Progress made by pupils, exited from the program. 
Unsatisfactory 

Below Average — ' 

Average 2 . liTajS 

Above Average 6 54. 6« 

Outstanding 2 ' IQ.2% 

How essential were Project BUILD services to your school? 

Advantageous 5 4*; 

Ineffectual - -f .fl^^ 

Would you like to participate in in-service training in 
Bilingual Learning Disabilities in the future? 

-V 7 ' 63.695 

S?hP^ 2 - 18.2^ 

2 . 18.2^ 
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SUMMARY OP RESPONSES FROM THIRTEEN (I3) QUESTIONNAIRES RECIEVED 
PROM PARENTS OF A TOTAL OF FIFTEEN (15) SUBMITTED 

i\ Meetings attended 



Meetings attended 0 1 2 ? 



1 



^Parents attending I 1 

WJiat type of communication have you recieved from Project 
BUIXd this year? 



None • 0 
Bulletins 4 
Letters \ 5 
Newsletters 6 



Teacher' s .Note 
Telephone Calls 
Home Visits 



9 
2 
1 



3. 



Does the Project Staff communicate with you in a language 
you understand well? (Orally or written). 



Yes 
No 



13 
0 



^. In what type of activity have you participated in this year? 



None 

Program planning ^ 
As a volunteer worker 
Parents Association 
Cultural Activitiies 
Other 



1 
5 

JJ 

7 
8 
1 



How many times, have you conferred with Project teachers? 

' \ 

0 1 2 3^567 



Frequency 



8 



10 



Number of parents 0 ( 
More than ten (10) times 



2 \ 2 



6. How many times have you observed teaching in Project BUILD 
classes? 



Frequency 



Number of parents 2 2 3 1 0 

Have you observed favorable changes in your child since he 
started in Project BUILD? 



Yes 
No 



12 
1 



8. Do you think that yovor childs participation in the Project 
has improved his/her school performance? 



Yes 
No 



13 
0 



/ / 
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9. Has the attitude of your child toward school improved 
since his/her assistance to Project BUILD? . 

Yes 12 
No ' 1. 

> 

10. Has your child's behavior st home improved since his/her 
assistance to Project BUILb classes? ^ 

/ - Yes 10 - ' . 

No ' 3 

11. Do you think that your child reads better? 



• / 



Yes 11 
No 1 



I 12. Do you think tliat your child speaks better? 

Yes 12 ^ , 

No- 1 ' . 

13. How would you rate parent participation in Project BUILD? 

Good 3 •, 

Average 6 
Below Average 1 
Poor 1 

li*. In general the quality of the Project's Staff appears to 
you asi 

Excellant 6 

Good 3 " 

Average 3 
Deficient 0 

No information 1 . 



